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-—A  basic  asr.unption  in  the  derivation  of  the  adaptive 
bcanforner  LMS  algorithm  is  that  the  input  sample  vector 
is  of  zero  mam;  v In  the  actual  hardware  implementation 
of  this  algorithm,  bias  errors  can  be  encountered  due  to 
system  electronics.  For  example,  if  the  be  an former  is 
operated  ror  a considerable  length  of  tine,  then  a small 
bias  in  a nominally  even  A/D  quantizer  can  seemingly  cause 
erroneous  algorithm  convergence  with  respect  to  the  expect- 
ed zero  mean  system  input.  This  memorandum  considers  some 
of  the  elemental  aspects  of  such  biasing  errors. 


The  biased  LMS  Algorithm 


Consider  the  sampled  vector 


- -r  -:-W- 


where  X is  the  true,  zero  mean  system  input  vector  and 
is  a constant  vector  which  Is  introduced  to  account  for 
biasing  of  the  actual  data.  Therefore,  if  the  super- 
script "T"  represents  the  vector  transpose,  then 
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and  the  correlation  matrix  Flgg  is  given  by 

= I:  fx„x' 
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(3) 
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where  i.  { * } is  the  expectation  operator  and  X and  R arc 
assumed  to  be  uncorr e 1 a t ed . 


The  beanformer  output  can  be  specified  as 


>’  ( t ) = »■:  X„ 


(5) 


(6) 


According  to  the  Least  Mean  Square  (LMS)  optimality 
criterion,  the  expected  squared  error 


n •{  e 2 | = K ■{  [ y ( t ) - d ( t ) ] “ 
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(8) 


is  to  be  minimized  by  selecting  W to  give  a best  mean 
square  estimate  of  the  desired  signal,  d(t).  Fxpanding 
( 8 ) gives 


b p}=  wrRBR!£-2WTK  |\Bd(t)|  ♦ I!  |d2(t)j 


= «TRxx]l+IiTJL  JiTw-2KTr+n  / d 2 ( t ) 
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where  B and  d(t)  are  assumed  to  be  uncorrclated.  The  mean 
squarelT  error  (10),  is  now  minimized  by  taking  the  gradient 
of  (10)  with  respect  to  W,  equating  to  zero  and  solving 
for  . Accordingly, 


v{c!}  ■ 2iRx, 


XX  * » 11  1»,  - 2!1 


Solving  for  JV  , the  biased  optimum  weight  vector,  gives 


»„  ■ t'x,  ♦ 11 


Notice,  that  for  R_  = (4,  i.e.  zero  input  bias  Wg  becomes 


— LMS  Rxx  - (13) 

the  desired  l. ! 1 S weight  vector.  Thus  the  bias  vector  can 
be  visualized  as  adding  a constant  bias  power  term  to 
each  element  of  the  actual  correlation  matrix  Rx  . 

Woodbury's  identity  can  be  applied  to  F.quation  (12) 
to  give 
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If  the  same  bias  component,  b,  is  present  in  all  terms  of 
X[5  then  £ can  he  written  as 


B = b I 


(HO 


where  1 is  a vector  of  ones  with  the  same  dimension  as  X_. 
Now,  Equation  (15)  reduces  to 
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In  addition,  if  R is  the  correlation  matrix  for  uncorrelat- 
ed noise  of  power  N0,  and  p^  is  the  ilii  element  of  P_,  then 
Equation  (17)  becomes 


(18) 


(19) 


where  K is  the  number  of  channels  in  the  system  and  L is 
the  number  of  time  delays  per  channel.  Thus,  only  if 
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N°  ( p * kl)  > > 2Pi 


the  optimum  weight  vector  for  this  case,  namely 


— LMS 


would  not  be  corrupted  significantly. 

. Convergence  of  the  Biased 

LMS  Algorithm 

The  instantaneous  gradient  of  e2  with  respect  to  W 
is  obtained  from  (10)  as 


G 2 ( i ) = WT(i)X(i)XT(i)K(i)  ♦ WT(i)BBTW(i)  - 2 !V  (i  ) P + df  t A ) 


where  the  i—  sampling  instant  is  considered.  The  gradient 
of  e2(i)  with  respect  to  W(i)  is 


V g 2 ( i ) = J(W(i)) 

W ( x ) 


2 [X (i)X(i)  + B _BT ] IV C i ) - 2 P (24) 
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giving  the  gradient  search  algorithm 

W(itl)  = K(i)  + p£(W(i))  (25) 

or 

W(i+1)  = [I  + 2U(X(i)X(i)  + £ 8r)]W(i)  - 2yP  . (26) 

The  mean  value  of  (26)  for  uncorrelated  £(i)  and  £(i)  is 
M(i  + 1 ) = E |lV(i  + l)|  (27) 

= [I  + 2p  (R  + B BT)]M(i)  - 2 P.  (28) 

A X 

A standard  convergence  proof  would  allow  convergence 
of  (28)  as  fol lows 

lim  M(n)  = [Rxx  + £ B 1 ] £ (29) 

n+oo  ~ 

only  if 

' ^x<  11  <3°> 

T 

where  Amax  is  the  maximum  eigenvalue  of  (Rxx  + £ £ ) . 
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an  estimate  of  the  actual  £ and  could  perhaps  be  obtained 
by  measuring,  over  an  interval,  the  mean  of  the  biased 
input  sample  vector  . 


Conclusions 

Bias  errors  due  to  system  electronics  for  the  implemen- 
tation of  the  LMS  adaptive  beamformer  have  been  considered. 
Basically,  the  bias  contributes  to  system  error  by  adding 
a constant  term,  or  bias  power,  to  each  term  in  the  actual 
system  input  correlation  matrix.  The  result  is  a biased  LMS 
filter  weight  vector  (see  Equation  (15)). 

To  obtain  some  insight,  the  simple  case  of  an  uncorrelat- 
ed noise  input  was  considered.  It  was  seen  that  the  optimum 
weights  were  all  biased  by  the  constant  factor.  The  amount 
of  the  bias  is  proportional  to  both  the  system  bias  power 
and  the  sum  of  the  elements  in  the  steering  vector, 

Also,  an  LMS  system  modification  is  suggested  which 
conceivably  could  eliminate  the  bias  at  the  input  by 
subtracting  an  estimate  of  the  mean  input  sample  vector. 
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